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DETAILED ACTION 

Claim Objections 

1. Claims 7 and 121 are objected to under 37 CFR 1.75(c), as being of improper dependent 
form for failing to further limit the subject matter of a previous claim. Applicant is required to 
cancel the claim(s), or amend the claim(s) to place the claim(s) in proper dependent form, or 
rewrite the claim(s) in independent form. Claim 7 is identical to claim 5. Claim 121 is identical 
to claim 119. 

Claim 160 is objected to because of the following informalities: The dependency upon 
claim 161 appears to be the result of a typo. It would appear that the claims should have been 
dependent upon claim 151. Appropriate correction is required. 



Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for 
Patent Subject Matter Eligibility" (Official Gazette notice of 22 
November 2005 1 Annex IV, reads as follows: 

Descriptive material can be characterized as either "functional descriptive material" or "nonfunctional descriptive 
material." In this context, "functional descriptive material" consists of data structures and computer programs 
which impart functionality when employed as a computer component. (The definition of "data structure" is "a 
physical or logical relationship among data elements, designed to support specific data manipulation functions." 
The New IEEE Standard Dictionary of Electrical and Electronics Terms 308 (5th ed. 1993).) "Nonfunctional 
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descriptive material" includes but is not limited to music, literary works and a compilation or mere arrangement 
of data. 

When functional descriptive material is recorded on some computer-readable medium it becomes structurally and 
functionally interrelated to the medium and will be statutory in most cases since use of technology permits the 
function of the descriptive material to be realized. Compare In re Lowry, 32 F.3d 1579, 1583-84, 32 USPQ2d 
1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a computer readable medium that increases 
computer efficiency held statutory) and Warmerdam, 33 F.3d at 1360-61, 31 USPQ2d at 1759 (claim to 
computer having a specific data structure stored in memory held statutory product-by-process claim) with 
Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 1760 (claim to a data structure per se held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program is a computer element 
which defines structural and functional interrelationships between the computer program and the rest of the 
computer which permit the computer program's functionality to be realized, and is thus statutory. See Lowry, 32 
F.3d at 1583-84, 32 USPQ2d at 1035. 



Claims 1-128 are rejected under 35 U.S.C. 101 because the claimed invention is directed 
to non-statutory subject matter as follows. Claims 1, 67 and 118 define a "system". However, 
while the preamble defines a "system", which would typically be indicative of an "apparatus", 
the body of the claim lacks definite structure indicative of a physical apparatus. The claims as a 
whole appears to be nothing more than a "system" of software elements, thus defining functional 
descriptive material per se. 

Functional descriptive material may be statutory if it resides on a "computer-readable 
medium or computer-readable memory". The claim(s) indicated above lack structure, and do not 
define a computer readable medium and are thus non-statutory for that reason (i.e., "When 
functional descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most cases since 
use of technology permits the function of the descriptive material to be realized" - Guidelines 
Annex IV). The scope of the presently claimed invention encompasses products that are not 
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necessarily computer readable, and thus NOT able to impart any functionality of the recited 
program. The examiner suggests: 

1 . Amending the claim(s) to embody the program on "computer-readable medium" 
or equivalent; assuming the specification does NOT define the computer readable medium as a 
"signal", "carrier wave", or "transmission medium" which are deemed non-statutory; or 

2. Adding structure to the body of the claim that would clearly define a statutory 
apparatus. 

Any amendment to the claim should be commensurate with its corresponding disclosure. 

Claim Rejections - 35 USC § 112 
3. The following is a quotation of the second paragraph of 35 U.S. C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

Claims 1-117 and 126-166 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

Claim 1 recites the limitation "the new faceprint" in lines 14 and 15. There is insufficient 
antecedent basis for this limitation in the claim. 



Claim 67 recites the limitation "the new faceprint" in lines 13, 15 and 18. There is 
insufficient antecedent basis for this limitation in the claim. 
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Claim 126 recites the limitation "the new faceprint" in lines 5, 7 and 10. There is 
insufficient antecedent basis for this limitation in the claim. 

Claim 129 recites the limitation "the new faceprint" in lines 9, 1 1 and 14. There is 
insufficient antecedent basis for this limitation in the claim. 

Claims 2-66, 68-1 17, 127, 128 and 130-166 arc rejected by the virtue of their dependency 
upon independent claims 1, 67, 126 and 129, but they also contain numerous instances of the 
limitation "the new faceprint", which all appear to lack antecedent basis. 

Regarding claims 67, 126 and 129, the phrase "such as" renders the claim indefinite 
because it is unclear whether the limitations following the phrase are part of the claimed 
invention. See MPEP § 2173.05(d). 

Claim 15 recites the limitation "i think it is ok to have such a list" in line 3. The 
limitation renders the claim indefinite. It appears to mistakenly inserted into the claim. 

Claim 16 recites the limitation "proximity" in line 1 . There is insufficient antecedent 
basis for this limitation in the claim. 
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Claim 23 recites the limitation "the first faceprint" in line 3. There is insufficient 
antecedent basis for this limitation in the claim. 

Claim 39 recites the limitation "Other modules/dependent features" in line 5. The 
limitation renders the claim indefinite. It appears to mistakenly inserted into the claim. 

Claim 144 recites the limitation "the detection of face candidate regions" in lines 1 and 2. 
There is insufficient antecedent basis for this limitation in the claim. 



Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 



5. Claims 1-18, 22, 25, 37-40, 49-51, 53, 54, 63-74, 78, 81, 83-96, 104, 105, 114-127, 129- 
134, 138, 141, 143, 145-151 and 160-166 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over US 2003/0198368 to Kee in view of an article "3D Pose Estimation and 
Normalization for Face Recognition by Jebara (already of record). 
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As to claim 1 , Kee discloses a processor-based system operating according to digitally- 
embedded programming instructions and communicating with one or more digital data storage 
media for classifying and archiving images including face regions that are acquired with a digital 
image acquisition device (Fig. 3 and paragraphs 33 and 71), the programming instructions 
comprising: 

(a) a face detection module for identifying a group of pixels corresponding to a face 
region within digital image data acquired by the acquisition device (Fig. 3, element 320 and 
paragraphs 33 and 37); 

(b) a normalization module for generating a normalized face region from said face region 
(Fig. 3, element 340 and paragraphs 39 and 46); 

(c) a face recognition module for extracting a set of values of face classifier parameters 
from said normalized face region, said set of face classifier parameter values being collectively 
known as a faceprint associated with said normalized face region (Fig. 3, element 350 and 
paragraph 47, wherein feature values corresponds to a faceprint); 

(d) a workflow module for comparing said extracted faceprint to a database 

of archived faceprints previously determined to correspond to one or more known identities, and 
for determining based on the comparing whether the new faceprint corresponds to any of the one 
or more known identities (Fig. 3, element 370 and paragraphs 52 and 53), the workflow module 
further for associating the new faceprint and normalized face region from which said faceprint is 
derived with a new or known identity within a database comprising other data corresponding to 



Application/Control Number: 10/764,274 Page 8 

Art Unit: 2624 

the archived faceprints and associated parent images for performing further comparisons with 
further faceprints (Fig. 3, elements 360 and 370 and paragraph 18, 49 and 58); and 

(e) a database module for archiving the data according to the associating by the workflow 
module within one or more digital data storage media (Fig. 3, element 380 and paragraphs 49 
and 58). 

Kee does not disclose expressly wherein normalization includes pose normalization of 
the face region. 

However, Jcbara discloses a process for face recognition including pose normalization of 
a face region (page 61, lines 14-23). 

Kee & Jebara are combinable because they are from the same art of facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the pose normalization process, as taught by Jebara, with the system disclosed 
by Kee. 

The suggestion/motivation for doing so would have been to provide a vision system 
which would permit automatic machine-based face detection and recognition in uncontrolled 
environments (Jebara, page 1, lines 11-12). 

Therefore, it would have been obvious to combine Kee with Jebara to obtain the 
invention as specified in claim 1 . 
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As to claim 2, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the identifying by the face detection module comprises determining a probability that 
the group of pixels comprises a face region (Kee, paragraph 37). 

As to claim 3, the combination of Kee and Jebara discloses the system of claim 2, wherein 
the identifying further comprises determining whether the probability lies above a predetermined 
threshold, and if not, automatically determining that the group of pixels does not comprise a face 
region (Kee, paragraph 37). 

As to claim 4, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the pose normalization comprises: 

(i) determining the pose of the confirmed face region (Jebara, page 61, lines 1 7-23); 

(ii) mapping said face region onto a 3d average-face model to create an interim 3d model 
of said face region (Jebara, pages 67-74, section 3); 

(iii) rotating said interim 3d model into full frontal alignment (Jebara, page 74-76, 
section 4); and 

(iv) translating the facial aspect of said interim 3d model back onto 2d image space to 
create a pose normalized face region (Jebara, page 74-76, section 4). 

As to claim 5, the combination of Kee and Jebara discloses the system of claim 4, 
wherein the determining of the pose of a confirmed face region further comprises: 
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(i) determining locations of principle facial feature within said face region (Jebara, page 
61, lines 14-15); 

(ii) determining at least two geometric relationships between said facial features {Jebara, 
page 61, lines 15-17); 

(iii) extrapolating from said geometric relationships the plane of the facial region, relative 
to the normal plane of the image acquisition apparatus thereby determining the facial pose 
relative to the normal plane of the image acquisition apparatus (Jebara, page 61, lines 17-18). 

As to claim 6, the combination of Kee and Jebara discloses the system of claim 5, 
wherein said principle facial features comprise at least two of eye-pair, nose and mouth regions 
(Jebara, page 61, lines 14-15). 

As to claim 7 please refer to the rejection of claim 5 above. 

As to claim 8, the combination of Kee and Jebara discloses the system of claim 4, 
wherein said mapping of said face region onto a 3d average-face model comprises an additional 
rescaling of said 3d average face model along at least one horizontal dimension, said additional 
rescaling being based on the at least two geometric relationships determined in the pose 
determining (Jebara, pages 67-74, section 3). 
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As to claim 9, the combination of Kee and Jebara discloses the system of claim 4, 
wherein the normalizing further comprises performing one or more additional normalizing 
operations on said pose normalized face region (Kee, paragraph 46 and Jebara, page 76, section 
5). 

As to claim 10, the combination of Kee and Jebara discloses the system of claim 9, 
wherein the one or more additional normalization operations comprise luminance, size, or 
orientation normalization, or combinations thereof (Kee, paragraph 46 and Jebara, page 76, 
section 5). 

As to claim 1 1, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the workflow module for determining that the new faceprint corresponds to a first 
identity, and the database module for archiving the new faceprint within a first face class, and 
wherein the face recognition module is further for comparing values of face classifier parameters 
of a second face class including a second faceprint image to values of the parameters 
corresponding to the first face class including the new faceprint, as well as to further face classes 
including further faceprints, and for determining based on the comparing whether the second 
faceprint matches any of the first and further face classes (Kee, Fig. 3, element 370 and 
paragraph 52 and 53). 

As to claim 12, the combination of Kee and Jebara discloses the system of claim 1, 
wherein one or more archived faceprints have been previously determined to correspond to the 
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one or more known identities, and the comparing by the workflow module comprises 
determining proximities of the values of the face classifier parameters of the new faceprint image 
with values corresponding to the one or more archived faceprints (Kee, Fig. 3, element 370 and 
paragraph 52 and 53). 

As to claim 13, the combination of Kee and Jebara discloses the system of claim 12, 
wherein the proximities of the values correspond to proximities of locations in the multi- 
dimensional mathematical space defined by the set of face classifier parameters which 
correspond to a faceprint (Kee, Fig. 3, element 370 and paragraph 52 and 53). 

As to claim 14, the combination of Kee and Jebara discloses the system of claim 13, 
wherein at least one proximity is statistically calculated based on comparisons with multiple 
archived faceprints corresponding to a same identity (Kee, Fig. 3, element 370 and paragraph 
52, 53 and 69). 

As to claim 15, the combination of Kee and Jebara discloses the system of claim 12, 
wherein the proximities of the values correspond to at least one of proximities of color, shape, or 
relative distances between identified locations within the faceprint images (Kee, Fig. 3, element 
370 and paragraphs 47, 52 and 53). 

As to claim 16, the combination of Kee and Jebara discloses the system of claim 11, 
wherein at least one proximity is statistically calculated based on comparisons with multiple 
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archived faceprints corresponding to a same identity (Kee, Fig. 3, element 370 and paragraph 
52, 53 and 69). 

As to claim 17, the combination of Kee and Jebara discloses the system of claim 12, 
wherein the determining by the face recognition module comprises automatically determining 
that the new faceprint corresponds to a known identity based on one or more geometric distance 
proximities being within a predetermined proximity threshold (Kee, Fig. 3, element 370 and 
paragraphs 47, 52 and 53). 

As to claim 18, the combination of Kee and Jebara discloses the system of claim 17, 
wherein at least one proximity is statistically calculated to be within the threshold when the 
probability that the proximity is within the threshold is above a predetermined probability value 
(Kee, Fig. 3, element 370 and paragraphs 52 and 53). 

As to claim 22, the combination of Kee and Jebara discloses the system of claim 12, 
wherein the determining by the workflow module comprises automatically determining that the 
new faceprint corresponds to a known identity when comparisons of the face classifier parameter 
values of the first face print with multiple archived faceprints corresponding to a same known 
identity each result in a determination of an identity match (Kee, Fig. 3, element 370 and 
paragraph 52, 53 and 69). 
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As to claim 25, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the associating by the workflow module comprises grouping the new faceprint with a 
new or prior face class defined by values of one or more face classifier parameters {Kee, Fig. 3, 
element 370 and paragraph 58). 

As to claim 37, the combination of Kee and Jebara discloses the system of claim 25, 
wherein the archiving of the new data corresponding to the face classifier parameters of the new 
faceprint comprises grouping the new faceprint within a previously-determined face class 
defined by sets of boundary face classifier parameter values including particular face classifier 
parameter values of the new faceprint (Kee, Fig. 3, element 370 and paragraph 58). 

As to claim 38, the combination of Kee and Jebara discloses the system of claim 37, 
wherein the archiving further comprises rc-defining the boundaries of the previously-determined 
face class based on one or more particular face classifier parameter values of the new faceprint 
being outside previously established boundary values (Kee, Fig. 3, element 370 and paragraph 
58). 

As to claim 39, the combination of Kee and Jebara discloses the system of claim 37, 
wherein the face class has been previously grouped with one or more other face classes within a 
same identity table corresponding to a same known identity, and wherein the archiving further 
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comprises adjusting boundary values of the identity table based on adjusted boundary values of 
the face class including the new faceprint (Kee, Fig. 3, element 370 and paragraph 58). 

As to claim 40, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the programming instructions further comprise an image detection module for 
determining that a new image is presented for face detection processing (Kee, Fig. 3, element 
310 and paragraph 36). 

As to claim 49, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the identifying by the face detection module applies automatic face region identification 
when a detection probability is calculated to be above a detection probability threshold (Kee, Fig. 
3, element 320 and paragraphs 33 and 37) or the comparing by the face recognition module 
applies automatic identity recognition when a matching probability with a prior faceprint is 
calculated to be above a matching probability threshold, or both (Kee, Fig. 3, element 370 and 
paragraphs 52 and 53). 

As to claim 50, the combination of Kee and Jebara discloses the system of claim 49, 
wherein the detection probability threshold or the matching probability threshold, or both, are 
adjustable (Kee, paragraph 58). 
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As to claim 51, the combination of Kee and Jebara discloses the system of claim 50, 
wherein the detection threshold or the matching threshold, or both, are adjustable by a user, a 
manufacturer, or an adaptive learning program of the system, or combinations thereof (Kee, 
paragraph 58). 

As to claim 53, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are principle component vectors derived from a set 
of eigenface descriptors (Kee, paragraph 47). 

As to claim 54, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are independent component vectors derived from an 
independent component analysis of a normalized face image (Kee, paragraph 47). 

As to claim 63, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the archiving further for enabling further comparisons with further faceprints and for 
recalling the faceprints and their associated normalized face regions and parent images (Kee, 
paragraph 58). 
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As to claim 64, the combination of Kee and Jebara discloses the method of claim 1, 
wherein the generating further comprises performing one or more additional normalizing 
operations (Kee, paragraph 46). 



As to claim 65, the combination of Kee and Jebara discloses the method of claim 64, 
wherein the performing comprises luminance, size, or orientation normalizing, or combinations 
thereof (Kee, paragraph 46). 



As to claim 66, the combination of Kee and Jebara discloses the method of claim 1, 
wherein the generating further comprises size normalizing of said face region (Kee, paragraph 
46). 



As to claim 67, please refer to 
As to claim 68, please refer to 
As to claim 69, please refer to 
As to claim 70, please refer to 
As to claim 71, please refer to 
As to claim 72, please refer to 
As to claim 73, please refer to 
As to claim 74, please refer to 
As to claim 78, please refer to 
As to claim 81, please refer to 



the rejection of claim 1 above, 
the rejection of claim 12 above, 
the rejection of claim 13 above, 
the rejection of claim 14 above, 
the rejection of claim 15 above, 
the rejection of claim 16 above, 
the rejection of claim 17 above, 
the rejection of claim 18 above, 
the rejection of claim 22 above, 
the rejection of claim 25 above. 
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As to claim 93, please refer to the rejection of claim 37 above. 
As to claim 94, please refer to the rejection of claim 38 above. 
As to claim 95, please refer to the rejection of claim 39 above. 
As to claim 96, please refer to the rejection of claim 40 above. 
As to claim 104, please refer to the rejection of claim 53 above. 
As to claim 105, please refer to the rejection of claim 54 above. 
As to claim 1 14, please refer to the rejection of claim 63 above. 
As to claim 115, please refer to the rejection of claim 64 above. 
As to claim 116, please refer to the rejection of claim 65 above. 
As to claim 1 17, please refer to the rejection of claim 66 above. 
As to claim 118, please refer to the rejection of claims 1 and 4 above. 
As to claim 119, please refer to the rejection of claim 5 above. 
As to claim 120, please refer to the rejection of claim 6 above. 
As to claim 121, please refer to the rejection of claim 5 above. 
As to claim 122, please refer to the rejection of claim 8 above. 
As to claim 123, please refer to the rejection of claim 9 above. 
As to claim 124, please refer to the rejection of claim 10 above. 
As to claim 125, please refer to the rejection of claim 66 above. 
As to claim 126, please refer to the rejection of claim 1 above. 
As to claim 127, please refer to the rejection of claim 63 above. 
As to claim 129, please refer to the rejection of claim 1 above. 
As to claim 130, please refer to the rejection of claim 12 above 
As to claim 131, please refer to the rejection of claim 13 above. 
As to claim 132, please refer to the rejection of claim 14 above. 
As to claim 133, please refer to the rejection of claim 17 above. 
As to claim 134, please refer to the rejection of claim 18 above. 
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As to claim 138, please refer to the rejection of claim 22 above. 
As to claim 141, please refer to the rejection of claim 25 above. 
As to claim 143, please refer to the rejection of claim 40 above. 
As to claim 145, please refer to the rejection of claim 63 above. 

As to claim 146, the combination of Kee and Jebara discloses the method of claim 129, 
further comprising verifying that the face region is similar enough to a face region of one or 
more known identities to be correctly recognized (Kee, Fig. 3, element 370 and paragraphs 52 
and 53). 

As to claim 147, the combination of Kee and Jebara discloses the method of claim 146, 
further comprising completing the recognition process by determining which of said known 
identities said face region should be associated with (Kee, Fig. 3, element 370 and paragraphs 
52 and 53). 

As to claim 148, the combination of Kee and Jebara discloses the method of claim 129, 
wherein the generating further comprises performing one or more additional normalizing 
operations (Kee, paragraph 46). 
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As to claim 149, the combination of Kee and Jebara discloses the method of claim 148, 
wherein the performing comprises luminance, size, or orientation normalizing, or combinations 
thereof (Kee, paragraph 46). 

As to claim 150, the combination of Kee and Jebara discloses the method of claim 129, 
wherein the generating further comprises size normalizing of said face region (Kee, paragraph 
46). 

As to claim 15 1, the combination of Kee and Jebara discloses the method of claim 129, 
further comprising archiving the new faceprint and its associated parent image, according to the 
associating, within one or more digital data storage media (Kee, Fig. 3, elements 360 and 370 
and paragraph 18, 49 and 58). 

As to claim 160, the combination of Kee and Jebara discloses the method of claim 151, 
wherein the archiving further comprises adjusting boundary face classifier parameter values of 
the identity based on parameters of the new face class (Kee, Fig. 3, elements 360 and 370 and 
paragraph 18, 49 and 58). 
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As to claim 161, the combination of Kee and Jebara discloses the method of claim 160, 
wherein the archiving further comprises adjusting boundary face classifier parameter values of a 
different identity based on parameters of the adjusted boundary values of the identity including 
the new face class (Kee, Fig. 3, elements 360 and 370 and paragraph 18, 49 and 58). 

As to claim 162, the combination of Kee and Jebara discloses the method of claim 151, 
wherein the archiving of the new data corresponding to the face classifier parameters of the new 
faceprint comprises grouping the new faceprint within a previously-determined face class 
defined by sets of boundary face classifier parameter values including particular face classifier 
parameter values of the new faceprint (Kee, Fig. 3, elements 360 and 370 and paragraph 18, 49 
and 58). 

As to claim 163, the combination of Kee and Jebara discloses the method of claim 162, 
wherein the archiving further comprises re-defining the boundaries of the previously-determined 
face class based on one or more particular face classifier parameter values of the new faceprint 
being outside previously established boundary values (Kee, Fig. 3, elements 360 and 370 and 
paragraph 18, 49 and 58). 

As to claim 164, the combination of Kee and Jebara discloses the method of claim 162, 
wherein the face class has been previously grouped with one or more other face classes within a 
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same identity table corresponding to a same known identity, and wherein the archiving further 
comprises adjusting boundary values of the identity table based on adjusted boundary values of 
the face class including the new faceprint (Kee, Fig. 3, elements 360 and 370 and paragraph 18, 
49 and 58). 



As to claim 165, please refer to the rejection of claim 63 above. 
As to claim 166, please refer to the rejection of claim 63 above. 

6. Claims 24, 26-36, 41, 42, 47, 48, 80, 82-92, 97, 98, 128, 140, 142 and 152-159 are 
rejected under 35 U.S. C. 103(a) as being unpatentable over Kee (already of record) and Jebara in 
view of US 2002/0132663 to Cumbers. 

As to claim 24, the combination of Kee and Jebara discloses the system of claim 12. 

The combination of Kee and Jebara does not disclose expressly wherein the determining 
by the workflow module comprises requesting user confirmation whether the new faceprint 
image corresponds to one or more known identities when comparison of the face classifier 
parameter values of the new faceprint with multiple archived faceprints corresponds to multiple 
know identities result in determination of identity matches with at least two different identities. 

However, Cumbers discloses a facial recognition system comprising requesting user 
confirmation whether the new faceprint image corresponds to one or more known identities 
when comparison of the face classifier parameter values of the new faceprint with multiple 
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archived faceprints corresponds to multiple know identities result in determination of identity 
matches with at least two different identities {paragraph 47). 

Kee, Jebara & Cumbers are combinable because they are from the same art of facial 
image processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the system of requesting user confirmation, as taught by Cumbers, with the 
system disclosed by Kee and Jebara. 

The suggestion/motivation for doing so would have been to resolve conflict and errors 
encountered by the biometric system (Cumbers, paragraph 7). 

Therefore, it would have been obvious to combine Kee and Jebara with Cumbers to 
obtain the invention as specified in claim 24. 

As to claim 26, the combination of Kee and Jebara discloses the system of claim 25. 

The combination of Kee and Jebara does not disclose expressly wherein when the 
determining by the workflow module results in no identity matches between the new faceprint 
and any known identity, the workflow module determines that the new faceprint image 
corresponds to a new identity and is grouped with a new face class defined by sets of boundary 
face classifier parameter values, and archives new data accordingly. 

However, Cumbers discloses a facial recognition system that when a determination 
results in no identity matches between the new faceprint and any known identity, the workflow 
module determines that the new faceprint image corresponds to a new identity and is grouped 
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with a new face class defined by sets of boundary face classifier parameter values, and archives 
new data accordingly (paragraph 50, wherein a doe file is created for new identities). 

Kee, Jebara & Cumbers are combinable because they are from the same art of facial 
image processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the system of handling no identity matches, as taught by Cumbers, with the 
system disclosed by Kee and Jebara. 

The suggestion/motivation for doing so would have been to track anonymous persons 
(Cumbers, paragraph 7). 

Therefore, it would have been obvious to combine Kee and Jebara with Cumbers to 
obtain the invention as specified in claim 26. 

As to claim 27, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 26, wherein the archiving of the new data corresponding to the face classifier parameters 
of the new faceprint corresponding to the new identity comprises associating the new data with 
archived data corresponding to one or more known identities based on a relationship between the 
new identity and the one or more known identities (Cumbers, paragraph 50). 

As to claim 28, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 26, wherein the archiving of the new data corresponding to the face classifier parameters 
of the new faceprint corresponding to the new identity comprises associating the new data with a 
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further new identity based on a relationship between the two new identities {Cumbers, paragraph 
50). 

As to claim 29, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 25, wherein the archiving of the new data corresponding to the face classifier parameters 
of the new faceprint comprises generating a new face class defined by sets of boundary face 
classifier parameter values including the particular face parameter values of the new face print 
image (Cumbers, paragraph 50). 

As to claim 30, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 27, wherein the archiving further comprises grouping the new face class with another face 
class within a same identity table corresponding to a same appearance of a known identity 
(Cumbers, paragraph 50). 

As to claim 3 1 , the combination of Kee, Jebara and Cumbers discloses the system of 
claim 30, wherein the archiving further comprises adjusting boundary face classifier parameter 
values of a different identity based on adjusted boundary values of the identity including the new 
face class (Cumbers, paragraph 50). 
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As to claim 32, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 29, wherein the archiving further comprises grouping the new face class within a first 
identity table, and grouping the first identity table with a second identity table, including a 
second face class, together within a same appearance table corresponding to a different 
appearances of a same known identity (Cumbers, paragraph 50). 

As to claim 33, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 29, wherein the archiving further comprises adjusting boundary face classifier parameter 
values of a different identity based on new or adjusted boundary values of the identity including 
the new face class (Cumbers, paragraph 50). 

As to claim 34, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 29, wherein the archiving further comprises grouping the new face class within a 
previously generated identity table including multiple face classes corresponding to multiple 
different values of face classifier parameters corresponding to a same appearance of a same 
identity (Cumbers, paragraph 50). 

As to claim 35, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 34, wherein the archiving further comprises adjusting boundary face classifier parameter 
values of the identity based on parameters of the new face class (Cumbers, paragraph 50). 
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As to claim 36, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 35, wherein the archiving further comprises adjusting boundary face classifier parameter 
values of a different identity based on parameters of the adjusted boundary values of the identity 
including the new face class (Cumbers, paragraph 50). 

As to claim 41, the combination of Kee and Cumbers discloses the system of claim 1, 
wherein the programming instructions further comprises a set of user interface modules for 
obtaining user input in the detection of face candidate regions, or the classifying, archiving or 
recalling of faceprints or associated normalized face regions, or combinations thereof (Cumbers, 
paragraph 47). 

As to claim 42, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 1, wherein the programming instructions are stored on or accessible by a stand alone 
processor-based device configured for receiving raw image data from a digital camera (Kee, Fig. 
3), and the device being coupled with or including user interface hardware, and upon which the 
classifying is performed (Cumbers, paragraph 47). 

As to claim 47, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 1 , wherein the identifying by the face detection module or the comparing by the face 
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recognition module, or both, comprises receiving and utilizing user input {Cumbers, paragraph 
47). 

As to claim 48, the combination of Kee, Jebara and Cumbers discloses the system of 
claim 1, wherein the identifying by the face detection module or the comparing by the face 
recognition module, or both, are configured for auto-processing subject to selective disablement 
of the auto-processing by a user (Cumbers, paragraph 47). 

As to claim 80, please refer to the rejection of claim 24 above. 

As to claims 82-92, please refer to the rejections of claims 26-36 above. 

As to claim 97, please refer to the rejection of claim 41 above. 

As to claim 98, please refer to the rejection of claim 42 above. 

As to claim 128, please refer to the rejection of claim 41 above. 

As to claim 140, please refer to the rejection of claim 24 above. 

As to claims 142, please refer to the rejections of claims 26 above. 

As to claims 152-159, please refer to the rejections of claims 27-34 above. 
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7. Claims 43-46, 52 and 99-103 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kee and Jebara in view of US 2002/0141586 to Margalit et al. ("Margalit"). 

As to claim 43, the combination of Kee and Jebara discloses system of claim 1. 

The combination of Kee and Jebara does not disclose expressly wherein the programming 
instructions are stored at least in part on an embedded appliance for performing some image 
classifying-related processing prior to outputting processed image data to a further processor- 
based device upon with classifying is further performed. 

Margalit discloses a facial recognition system comprising programming instructions are 
stored at least in part on an embedded appliance for performing some image classifying-related 
processing prior to outputting processed image data to a further processor-based device upon 
which classifying is further performed (Figs. 10C and 13Cand paragraphs 53, 59 and 157). 

Kee, Jebara & Margalit are combinable because they are from the same art of image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine an embedded appliance for performing some image classifying-related 
processing to output processed image data to a further processor-based device upon which 
classifying is further performed, as taught by Margalit, with the system disclosed by Kee and 
Jebara. 

The suggestion/motivation for doing so would have been to provide a portable device 
capable of communicating with an authenticator for authentication of identity (Margalit, 
Abstract and paragraph 16). 
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Therefore, it would have been obvious to combine Kee and Jebara with Margalit to 
obtain the invention as specified in claim 43. 

As to claim 44, the combination of Kee, Jebara and Margalit discloses the system of 
claim 43, wherein the embedded appliance comprises a digital camera (Margalit, Figs. 10C and 
13C and paragraphs 53, 59 and 157). 

As to claim 45, the combination of Kee, Jebara and Margalit discloses the system of 
claim 44, wherein the digital camera comprises a dedicated digital camera or a camera-capable 
handheld pda or phone, or a combination thereof {Margalit, Figs. IOC and 13C and paragraphs 
53, 59 and 157). 

As to claim 46, the combination of Kee, Jebara and Margalit discloses the system of 
claim 1 , wherein the programming instructions are stored at least in part on a processor-based 
device connected to a network for performing some image classifying-related processing on the 
device prior to outputting processed data to a back-end server upon which the classifying is 
further performed {Margalit, Figs. 10C and 13C and paragraphs 53, 59 and 157). 

As to claim 52, the combination of Kee, Jebara and Margalit discloses the system of 
claim 1 , wherein the programming instructions are stored on or accessible by processor-based 
components within a digital camera upon which the classifying is performed (Margalit, Figs. 
10C and 13C and paragraphs 53, 59 and 157). 
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As to claim 99, please refer to the rejection of claim 43 above. 
As to claim 100, please refer to the rejection of claim 44 above. 
As to claim 101, please refer to the rejection of claim 45 above. 
As to claim 102, please refer to the rejection of claim 46 above. 
As to claim 103, please refer to the rejection of claim 52 above. 

8. Claims 55-58 and 106-109 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kee (already of record) and Jebara (already of record). 

As to claim 55, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are derived from a mathematical transform of the 
normalized face region {paragraph 47). 

The combination of Kee and Jebara does not disclose expressly wherein the set of face 
classifier parameters are fourier components derived from a 2d fourier transform of the 
normalized face region. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to derive a set of face classifier parameters comprising fourier components from a 2d 
fourier transform, since this practice is well known in the art of facial image processing. 
Therefore, the Examiner takes Official Notice that it would have been obvious to combine the 
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process of deriving a set of face classifier parameters comprising fourier components from a 2d 
fourier transform to the system disclosed by Kee and Jebara to obtain the invention as specified 
in claim 55. 

As to claim 56, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are derived from a mathematical transform of the 
normalized face region (paragraph 47). 

The combination of Kee and Jebara does not disclose expressly wherein the set of face 
classifier parameters are fourier transform vectors derived from a 2d discrete cosine transform of 
the normalized face region. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to derive a set of face classifier parameters comprising fourier transform vectors from a 2d 
discrete cosine transform, since this practice is well known in the art of facial image processing. 
Therefore, the Examiner takes Official Notice that it would have been obvious to combine the 
process of deriving a set of face classifier parameters comprising fourier transform vectors from 
a 2d discrete cosine transform to the system disclosed by Kee and Jebara to obtain the invention 
as specified in claim 56. 

As to claim 57, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are derived from a mathematical transform of the 
normalized face region {paragraph 47). 
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The combination of Kee and Jebara does not disclose expressly wherein the set of face 
classifier parameters are wavelet transform components derived from a 2d wavelet transform of 
the normalized face region. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to derive a set of face classifier parameters comprising wavelet transform components 
from a 2d wavelet transform, since this practice is well known in the art of facial image 
processing. Therefore, the Examiner takes Official Notice that it would have been obvious to 
combine the process of deriving a set of face classifier parameters comprising wavelet transform 
components from a 2d wavelet transform to the system disclosed by Kee and Jebara to obtain the 
invention as specified in claim 57. 

As to claim 58, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are derived from a mathematical transform of the 
normalized face region {paragraph 47). 

The combination of Kee and Jebara does not disclose expressly wherein the set of face 
classifier parameters are gabor transform components derived from a 2d gabor transform of the 
normalized face region. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to derive a set of face classifier parameters comprising gabor transform components from 
a 2d gabor transform, since this practice is well known in the art of facial image processing. 
Therefore, the Examiner takes Official Notice that it would have been obvious to combine the 
process of deriving a set of face classifier parameters comprising gabor transform components 
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from a 2d gabor transform to the system disclosed by Kee and Jebara to obtain the invention as 
specified in claim 58. 

As to claims 106-109, please refer to the rejection of claims 53-58 above. 

9. Claims 59, 60, 110 and 111 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kee and Jebara in view of US 2003/0086593 to Liu et al. ("Liu"). 

As to claim 59, the combination of Kee and Jebara discloses the system of claim 1, 
wherein the set of face classifier parameters are derived from a mathematical transform of the 
normalized face region (paragraph 47). 

The combination of Kee and Jebara does not disclose expressly wherein the set of face 
classifier parameters comprises a combination of two or more of principle components vectors, 
independent component vectors, fourier components, discrete cosine transform components, 
wavelet transform components and gabor transform components. 

However, Liu discloses a set of face classifier parameters comprises a combination of 
two or more of principle components vectors, independent component vectors, fourier 
components, discrete cosine transform components, wavelet transform components and gabor 
transform components (Abstract and paragraph 37). 

Kee, Jebara & Liu are combinable because they are from the same art of facial image 
processing. 
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At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to use a combination of gabor and wavelet transform components to represent the face 
classifier parameters, as taught by Liu, with the system disclosed by Kee and Jebara. 

The suggestion/motivation for doing so would have been because gabor wavelets exhibit 
strong characteristics of spatial locality and orientation selectivity, and are optimally localized in 
the space and frequency domains. 

Therefore, it would have been obvious to combine Kee and Jebara with Liu to obtain the 
invention as specified in claim 59. 

As to claim 60, the combination of Kee, Jebara and Liu discloses the system of claim 59, 
wherein the set of face classifier parameters includes additional classifiers or subsets thereof 
which further characterize the shape, texture, color distribution or localized physical features of 
the face region (Kee, paragraph 47). 

As to claims 110 and 111, please refer to the rejection of claim 62 and 63 above. 

10. Claim 144 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kee and Jebara 
in view of US 2006/0228040 to Simon et al. ("Simon"). 

As to claim 144, Kee and Jebara discloses method of claim 129. 
The combination of Kee and Jebara does not disclose expressly further comprising 
obtaining user input in the detection of face candidate regions. 
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However, Simon discloses obtaining user input in the detection of face candidate regions 
(Fig. 2A, element 225). 

Kee, Jebara & Simon are combinable because they are from the same art of facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the process of obtaining user input in the detection of face candidate regions, 
as taught by Simon, with the method disclosed by Kee and Jebara. 

The suggestion/motivation for doing so would have been to provide the ability for user 
adjustment of the detected face region (Simon, paragraph 49). 

Therefore, it would have been obvious to combine Kee and Jebara with Simon to obtain 
the invention as specified in claim 144. 



Double Patenting 

1 1 . The nonstatutory double patenting rejection is based on a judicially created doctrine 
grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or 
improper timewise extension of the "right to exclude" granted by a patent and to prevent possible 
harassment by multiple assignees. A nonstatutory obviousness-type double patenting rejection 
is appropriate where the conflicting claims are not identical, but at least one examined 
application claim is not patentably distinct from the reference claim(s) because the examined 
application claim is either anticipated by, or would have been obvious over, the reference 
claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re 
Goodman, 1 1 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887, 225 
USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re 
Vogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 
USPQ 644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may 
be used to overcome an actual or provisional rejection based on a nonstatutory double patenting 
ground provided the conflicting application or patent either is shown to be commonly owned 
with this application, or claims an invention made as a result of activities undertaken within the 
scope of a joint research agreement. 
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Effective January 1, 1994, a registered attorney or agent of record may sign a terminal 
disclaimer. A terminal disclaimer signed by the assignee must fully comply with 37 CFR 
3.73(b). 

Claim 1 is provisionally rejected on the ground of nonstatutory obviousness-type double 
patenting as being unpatentable over claim 1 of copending Application No. 10/763,801 in view 
of the article "3D Pose Estimation and Normalization for Face Recognition by Jebara (already of 
record). 

Claim 1 of application 10/763,801 discloses all the limitations of claim 1 in the present 
application except for "including pose normalizing said face region". 

Jebara discloses a system for face region normalization, see page 61. 

Application 10/763,801 & Jebara are combinable because they are from the same art of 
facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the pose normalization process, as taught by Jebara, with the system disclosed 
by application 10/763,801. 

The suggestion/motivation for doing so would have been to provide a vision system 
which would permit automatic machine-based face detection and recognition in uncontrolled 
environments {Jebara, page 1, lines 11-12). 

Therefore, it would have been obvious to combine application 10/763,801 with Jebara to 
obtain the invention as specified in claim 1 . 

Claim 1 is provisionally rejected on the ground of nonstatutory obviousness-type double 
patenting as being unpatentable over claim 1 of copending Application No. 10/764,336 in view 
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of the article "3D Pose Estimation and Normalization for Face Recognition by Jebara (already of 
record). 

Claim 1 of application 10/764,336 discloses all the limitations of claim 1 in the present 
application except for "including pose normalizing said face region". 

Jebara discloses a system for face region normalization, see page 61. 

Application 10/764,336 & Jebara are combinable because they are from the same art of 
facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the pose normalization process, as taught by Jebara, with the system disclosed 
by application 10/764,336. 

The suggestion/motivation for doing so would have been to provide a vision system 
which would permit automatic machine-based face detection and recognition in uncontrolled 
environments {Jebara, page 1, lines 11-12). 

Therefore, it would have been obvious to combine application 10/764,336 with Jebara to 
obtain the invention as specified in claim 1 . 

Claim 1 is provisionally rejected on the ground of nonstatutory obviousness-type double 
patenting as being unpatentable over claim 1 of copending Application No. 10/764,339 in view 
of the article "3D Pose Estimation and Normalization for Face Recognition by Jebara (already of 
record). 

Claim 1 of application 10/764,339 discloses all the limitations of claim 1 in the present 
application except for "including pose normalizing said face region". 
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Jebara discloses a system for face region normalization, see page 61. 

Application 10/764,339 & Jebara are combinable because they are from the same art of 
facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to combine the pose normalization process, as taught by Jebara, with the system disclosed 
by application 10/764,339. 

The suggestion/motivation for doing so would have been to provide a vision system 
which would permit automatic machine-based face detection and recognition in uncontrolled 
environments {Jebara, page 1, lines 11-12). 

Therefore, it would have been obvious to combine application 10/764,339 with Jebara to 
obtain the invention as specified in claim 1 . 

These are provisional obviousness-type double patenting rejections. 

Allowable Subject Matter 

12. Claims 19-21,23,61,62,75-77,79, 112, 113, 135-137 and 139 would be allowable if 
rewritten to overcome the rejection(s) under 35 U.S. C. 112, 2nd paragraph, set forth in this 
Office action and to include all of the limitations of the base claim and any intervening claims. 

Conclusion 

1 3 . The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 
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US 2001/0031 129 to Tajima discloses a system for face detection. 
US 2004/0136574 to Kozakaya et al. discloses a system for face detection. 
US 2008/0137919 to Kozakaya et al. discloses a system for face detection. 
USPN 6,142,876 to Cumbers discloses a system for face detection. 
USPN 6,234,900 to Cumbers discloses a system for face detection. 
USPN 6,554,705 to Cumbers discloses a system for face detection. 
USPN 6,783,459 to Cumbers discloses a system for face detection. 
USPN 6,928,231 to Tajima discloses a system for face detection. 
USPN 7,175,528 to Cumbers discloses a system for face detection. 
USPN 7,187,786 to Kee discloses a system for face detection. 
USPN 7,324,670 to Kozakaya et al. discloses a system for face detection. 
USPN 7,357,717 to Cumbers discloses a system for face detection. 



14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to AARON W. CARTER whose telephone number is (571)272- 
7445. The examiner can normally be reached on 8am - 4:30 am (Mon. - Fri.). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Brian Werner can be reached on (571) 272-7401 . The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Aaron W Carter/ 

Primary Examiner, Art Unit 2624 



